A neural network architecture optimizer based on DARTS and generative adversarial learning
نویسندگان
چکیده
Neural network architecture search automatically configures a set of architectures according to the targeted rules. Thus, it relieves human-dependent effort and repetitive resources consumption for designing neural makes task finding optimum with better performance much more accessible. Network methods based on differentiable (DARTS), however, introduces parameter redundancy. To address this issue, work presents novel method optimizing that combines DARTS generative adversarial learning (GAL). We first find module structures utilizing algorithm. Afterwards, retrieved modules are stacked derive initial architecture. Next, GAL is used prune some branches network, thereby obtaining final The proposed DARTS-GAL re-optimizes searched by simplify connection reduce parameters without compromising performance. Experimental results benchmark datasets, i.e., Mixed National Institute Standards Technology (MNIST), FashionMNIST, Canadian Advanced Research10 (CIFAR10), Research100 (CIAFR100), Cats vs Dogs, voiceprint recognition indicate test accuracies higher than those in majority cases. In particular, solution exhibits an improvement accuracy 7.35% CIFAR10 compared DARTS, attaining state-of-the-art result 99.60%. Additionally, number derived significantly lower method, pruning rate 62.3% at highest case.
منابع مشابه
Metric Learning-based Generative Adversarial Network
Generative Adversarial Networks (GANs), as a framework for estimating generative models via an adversarial process, have attracted huge attention and have proven to be powerful in a variety of tasks. However, training GANs is well known for being delicate and unstable, partially caused by its sigmoid cross entropy loss function for the discriminator. To overcome such a problem, many researchers...
متن کاملAdversarial Examples Generation and Defense Based on Generative Adversarial Network
We propose a novel generative adversarial network to generate and defend adversarial examples for deep neural networks (DNN). The adversarial stability of a network D is improved by training alternatively with an additional network G. Our experiment is carried out on MNIST, and the adversarial examples are generated in an efficient way compared with wildly-used gradient based methods. After tra...
متن کاملEnergy-based Generative Adversarial Network
We introduce the “Energy-based Generative Adversarial Network” model (EBGAN) which views the discriminator as an energy function that associates low energies with the regions near the data manifold and higher energies with other regions. Similar to the probabilistic GANs, a generator is trained to produce contrastive samples with minimal energies, while the discriminator is trained to assign hi...
متن کاملA New Architecture Based on Artificial Neural Network and PSO Algorithm for Estimating Software Development Effort
Software project management has always faced challenges that have often had a great impact on the outcome of projects in future. For this, Managers of software projects always seek solutions against challenges. The implementation of unguaranteed approaches or mere personal experiences by managers does not necessarily suffice for solving the problems. Therefore, the management area of software p...
متن کاملWasserstein Generative Adversarial Network
Recent advances in deep generative models give us new perspective on modeling highdimensional, nonlinear data distributions. Especially the GAN training can successfully produce sharp, realistic images. However, GAN sidesteps the use of traditional maximum likelihood learning and instead adopts an two-player game approach. This new training behaves very differently compared to ML learning. Ther...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Information Sciences
سال: 2021
ISSN: ['0020-0255', '1872-6291']
DOI: https://doi.org/10.1016/j.ins.2021.09.041